Refrigerator

ABSTRACT

Disclosed is a refrigerator. The refrigerator includes a main body having a first storage compartment and a second storage compartment, in which food is stored, a first door configured to open the first storage compartment via pivotal rotation thereof, a second door configured to be moved forward of the second storage compartment to open the second storage compartment, a receptacle configured to be moved along with the second door and received in the second storage compartment, the receptacle serving to store food therein, and a camera installed to the main body to take a picture of the receptacle. The refrigerator further includes a control unit configured to combine a plurality of pictures taken by the camera as the second door is moved and configured to correct the images into an image showing the receptacle.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation Application of prior U.S. patentapplication Ser. No. 15/496,260, filed on Apr. 25, 2017, which is aContinuation Application of prior U.S. patent application Ser. No.14/978,661 filed on Dec. 22, 2015, now U.S. Pat. No. 9,661,279 issued onMay 23, 2017, which is a Continuation Application of prior U.S. patentapplication Ser. No. 14/191,940 filed on Feb. 27, 2014, now U.S. Pat.No. 9,255,730 issued on Feb. 9, 2016, which claims priority under 35U.S.C. § 119 to Korean Application No. 10-2013-0038227, filed on Apr. 8,2013, whose entire disclosures are hereby incorporated by reference.

BACKGROUND OF THE INVENTION Field of the Invention

The present invention relates to a refrigerator, and more particularlyto a refrigerator which may provide a user with information related tofood stored in the refrigerator.

Discussion of the Related Art

In general, a refrigerator is an apparatus that supplies cold airgenerated via driving of a refrigeration cycle and serves to store foodin a low temperature state.

Conventional refrigerators may implement only a simple function ofstoring food in a low temperature state. However, in recent years, aneed for additional functions except for a food storage function isincreasing.

A refrigerator is configured to receive and store certain items andrequires a user to open a refrigerator door in order to check theinterior of the refrigerator. Moreover, if the user does not know thequantities and kinds of food stored in a refrigerator when trying to buyfood, this may cause inconvenience because the user may buy food alreadystored in the refrigerator or fail to buy necessary food.

Therefore, various research is currently being conducted to solve theabove-described user inconvenience.

SUMMARY OF THE INVENTION

Accordingly, the present invention is directed to a refrigerator thatsubstantially obviates one or more problems due to limitation anddisadvantages of the related art.

One object of the present invention is to provide a refrigerator whichmay provide a user with information related to food stored in therefrigerator.

Another object of the present invention is to provide a refrigeratorwhich may allow a user to intuitively and easily recognize food storedin the refrigerator.

Additional advantages, objects, and features of the invention will beset forth in part in the description which follows and in part willbecome apparent to those having ordinary skill in the art uponexamination of the following or may be learned from practice of theinvention. The objectives and other advantages of the invention may berealized and attained by the structure particularly pointed out in thewritten description and claims hereof as well as the appended drawings.

To achieve these objects and other advantages and in accordance with thepurpose of the present invention, as embodied and broadly describedherein, a refrigerator includes a main body having a storage compartmentin which food is stored, a door configured to be moved forward of thestorage compartment to open the storage compartment, a receptacleconfigured to be moved along with the door and received in the storagecompartment, the receptacle serving to store food therein, a camerainstalled to the main body to capture an image of the receptacle, acontrol unit configured to combine an image captured by the camera in aclosed state of the door and an image captured by the camera in an openstate of the door with each other and configured to correct the imagesinto an image showing the receptacle, and a display unit configured toshow the corrected image to a user.

The open state of the door may include a state in which the door is openand is stationary.

The open state of the door may include a state in which the door is openand is moving.

The camera may be located in a front region of the storage compartment.

The camera may be installed to capture an image of the receptacle withina maximum withdrawal region of the receptacle.

The corrected image may show the receptacle looked down from the upperside.

The refrigerator may further include a receptacle position sensing unitconfigured to sense a position of the receptacle, and the camera maytake a picture when a specific portion of the receptacle passes apredetermined position.

The refrigerator may further include a receptacle movement directionsensing unit configured to sense a movement direction of the receptacle,and the camera may take a picture when the receptacle is moved to beintroduced into the storage compartment.

The refrigerator may further include a door opening/closing sensing unitconfigured to sense opening/closing of the door.

The storage compartment may include a first storage compartment and asecond storage compartment, in which food is stored, and the camera maybe installed to a barrier, the barrier dividing the first storagecompartment and the second storage compartment into separate spaces.

In accordance with another aspect of the present invention, arefrigerator includes a main body having a storage compartment in whichfood is stored, a drawer configured to be introduced into or withdrawnfrom the storage compartment, the drawer having a receptacle in whichfood is stored, a camera configured to capture an image of thereceptacle, a control unit configured to combine an image captured bythe camera in a closed state of the drawer and an image captured by thecamera in an open state of the drawer with each other and configured tocorrect the images into an image showing the receptacle, and a displayunit configured to show the corrected image to a user.

The open state of the drawer may include a state in which the drawer isopen and is stationary.

The open state of the drawer may include a state in which the drawer isopen and is moving.

The camera may be located in a front region of the receptacle.

The camera may be installed to capture an image of the receptacle withina maximum withdrawal region of the receptacle.

The refrigerator may further include a drawer opening/closing sensingunit configured to sense opening/closing of the drawer, and the cameramay take a picture based on an elapsed time when the draweropening/closing sensing unit senses opening of the drawer.

The refrigerator may further include a communication unit configured totransmit the image to an external device.

The refrigerator may further include an image storage unit configured tostore the last image corrected by the control unit.

The refrigerator may further include a communication unit configured totransmit the last image stored in the image storage unit to an externaldevice.

In accordance with a further aspect of the present invention, a storageapparatus includes a main body having a storage chamber in which anarticle is stored, a drawer configured to be moved forward of the mainbody, a camera located in a front region of the storage chamber tocapture an image of the interior of the drawer in a state in which thedrawer is withdrawn to the maximum extent, a control unit configured tocombine an image captured by the camera in a closed state of the drawerand an image captured by the camera in an open state of the drawer witheach other and configured to correct the images into an image showingthe interior of the drawer, and a display unit configured to show thecorrected image to a user.

The open state of the drawer may include a state in which the drawer isopen and is stationary.

The open state of the drawer may include a state in which the drawer isopen and is moving.

It is to be understood that both the foregoing general description andthe following detailed description of the present invention areexemplary and explanatory and are intended to provide furtherexplanation of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the present invention and are incorporated in andconstitute a part of this application, illustrate embodiment(s) of theinvention and together with the description serve to explain theprinciple of the invention. In the drawings:

FIG. 1 is a front perspective view of a refrigerator according to oneembodiment of the present invention;

FIG. 2 is a control block diagram of a terminal according to the presentinvention;

FIG. 3 is a control block diagram according to one embodiment of thepresent invention;

FIGS. 4 to 6 are explanatory views of operation according to oneembodiment of the present invention;

FIG. 7 is a control flowchart showing a picture taking process based onan elapsed time as a second door is open according to one embodiment ofthe present invention;

FIG. 8 is a control flowchart showing a picture taking process based ona movement direction of a second door according to one embodiment of thepresent invention;

FIG. 9 is a view showing a plurality of pictures;

FIG. 10 is a view showing a state in which the pictures of FIG. 9 arecorrected and transmitted to a terminal;

FIG. 11 is a view showing an implementation example that a user isusable in the state of FIG. 10;

FIG. 12 is a front perspective view of a refrigerator according toanother embodiment of the present invention;

FIG. 13 is a control block diagram according to another embodiment ofthe present invention;

FIG. 14 is an explanatory view of operation according to anotherembodiment of the present invention;

FIG. 15 is a view showing a plurality of pictures;

FIG. 16 is a front perspective view of a refrigerator according to afurther embodiment of the present invention;

FIG. 17 is a control block diagram according to a further embodiment ofthe present invention;

FIG. 18 is an explanatory view showing a picture taking direction of acamera in brief according to a further embodiment;

FIG. 19 is an explanatory view of operation according to a furtherembodiment;

FIG. 20 is a view showing a state in which a picture is transmitted to aterminal according to a further embodiment; and

FIG. 21 is a control flowchart showing a picture taking process based onoperation of a drawer according to a further embodiment.

DETAILED DESCRIPTION OF THE INVENTION

Hereinafter, exemplary embodiments of the present invention that mayrealize the above-described objects concretely will be described withreference to the accompanying drawings.

In the drawings, the shape, size, or the like of components may beexaggerated for clarity and convenience. In addition, the termsparticularly defined in consideration of configurations and operationsof the present invention may be replaced by other terms based onintensions of those skilled in the art or customs. The meanings of theseterms may be construed based on the overall content of thisspecification.

FIG. 1 is a front perspective view of a refrigerator according to oneembodiment of the present invention. A description with reference toFIG. 1 will follow.

The refrigerator according to one embodiment of the present inventionincludes a main body 2 defining an external appearance of therefrigerator, the main body 2 providing a first storage compartment 12and a second storage compartment 18 as cold air receiving spacestherein, a first door 10 configured to open the first storagecompartment 12, and a second door 20 configured to open the secondstorage compartment 18.

The first door 10 may open the first storage compartment 12 via pivotalrotation thereof. A plurality of first doors 10 may be provided, suchthat the first doors 10 may be arranged respectively at both sides ofthe first storage compartment 12 so as to be pivotally rotated inopposite directions. In this case, the first doors 10 may be connectedto the main body 2 via hinges.

The second door 20 may be moved forward of the second storagecompartment 18 to open the second storage compartment 18. In this case,rails 22 may be provided at both sides of the second door 20 to guidemovement of the second door 20. As such, the second door 20 may slideforward or rearward of the second storage compartment 18.

A cold air duct 9 is provided in the first storage compartment 12 tosupply cold air passed through an evaporator into the first storagecompartment 12. In detail, a part of cold air passed through theevaporator may be supplied into the first storage compartment 12 throughthe cold air duct 9.

In addition, a plurality of shelves 14, on which food will be put, maybe provided in the first storage compartment 12. A variety of foods mayrest on the plurality of shelves 14. The plurality of shelves 14 may beinstalled at different heights, and some of the plurality of shelves 14may define an open space therebelow.

A drawer 40 may be provided in the space defined below the shelf 14. Inthis case, the drawer 40 may allow food to be stored in the lower spacedefined below the shelf 14 and may be introduced into or withdrawn fromthe lower space.

Alternatively, a plurality of drawers 40 may be provided to divide thelower space defined by the shelf 14 into a plurality of spaces that maybe individually used.

More than one light source 86 to emit light may be installed in thefirst storage compartment 12 and serve to emit light to the firststorage compartment 12 when a user opens the first door 10.

The first storage compartment 12 and the second storage compartment 18may provide storage spaces having different interior temperatures. Inparticular, if any one of the first storage compartment 12 or the secondstorage compartment 18 is a refrigerating compartment, the other one maybe a freezing compartment.

The main body 2 may be provided with a barrier 6 to structurallyseparate the first storage compartment 12 and the second storagecompartment 18 from each other. In this case, the barrier 6 may beconfigured to horizontally extend such that the first storagecompartment 12 is defined above the barrier 6 and the second storagecompartment 18 is defined below the barrier 6.

In addition, the barrier 6 may have a prescribed thickness to endure atemperature difference between the first storage compartment 12 and thesecond storage compartment 18.

According to one embodiment of the present invention, a receptacle 30,in which food is stored, is mounted to one side of the second door 20.The receptacle 30 may be moved along with the second door 20 andreceived in the second storage compartment 18. The receptacle 30 maytake the form of a top opened basket, and thus the user may access thereceptacle 30 after outwardly withdrawing the second door 20.

A camera 100 to take a picture of the receptacle 30 may be installed inthe second storage compartment 18. In this case, the camera 100 may bemounted to the main body 2, i.e. the barrier 6.

The camera 100 may be oriented to take a picture downwardly. The picturetaken by the camera 100 may provide an image as if the user looks downthe receptacle 30.

More than one light source 86 may be installed in the second storagecompartment 18 to emit light to the second storage compartment 18. Inthis case, the light source 86 may emit light to the receptacle 30 whenthe user opens the second storage compartment 18, i.e. when the seconddoor 20 is withdrawn.

Alternatively, the light source 86 may emit light to a picture takingrange of the camera 100 when the camera 100 takes a picture.

Although not shown in FIG. 1, the first door 10 may be provided with adisplay unit 120. In this case, the display unit 120 may provide theuser with various information including, e.g. food stored in therefrigerator, and transmit information input by the user to otherdevices.

More specifically, the display unit 120 may have various forms so longas it displays prescribed information and enables touch input of aprescribed instruction. In one example, the display unit 120 may takethe form of a touchscreen that realizes simultaneous input and display.

The display unit 120 may be separably coupled to a front surface of thefirst door 10. Thus, the user may attach or detach the display unit 120to or from the refrigerator as needed.

In the present invention, prescribed information displayed on thedisplay unit 120 may be transmitted to a terminal 200 that is connectedto the refrigerator through a network. The terminal 200 may take theform of a smart-phone that is not integrated with the refrigerator, butindependent of the refrigerator to allow the user to carry the terminal200 to a remote place where the refrigerator is not present.

Accordingly, the user who possesses the terminal 200 may recognizeinformation related to the interior of the refrigerator, moreparticularly information related to food stored in the receptacle 30even if the user does not access the refrigerator.

With reference to FIG. 2, the terminal 200 according to the presentinvention may include a terminal communication unit 210, an Audio/Video(A/V) input unit 220, a user input unit 230, a terminal output unit 240,a memory 250, an interface unit 260, a Radio Frequency Identification(RFID) reader 270, a terminal controller 280, and a power supply unit290, for example. Note that components shown in FIG. 2 are notessential, and the terminal 200 having a greater or less number ofcomponents may be employed.

Hereinafter, the aforementioned components will be described in order.

The terminal communication unit 210 may include one or more modules toenable use of the Internet between the terminal 200 and a wirelesscommunication system or in an Internet protocol network in which theterminal 200 is located.

For example, the terminal communication unit 210 may include a broadcastreception module 211, a mobile communication module 212, an Internetmodule 213, and a short-range communication module 214.

The broadcast reception module 211 receives broadcast signals and/orbroadcast information from an external broadcast management serverthrough a broadcast channel under control of the terminal controller280, and plays back the same on the display module 241.

The mobile communication module 212 implements transmission/reception ofwireless signals with at least one of a base station, an externalterminal, and a server through a mobile communication network. Thewireless signals may include voice signals, video call signals, orvarious other data based on transmission/reception of text/multimediamessages.

The Internet module 213 refers to a module for wired/wireless Internetconnection. Wireless Internet technologies may include Wireless LAN(WLAN)(Wi-Fi), wireless broadband (WiBro), World Interoperability forMicrowave Access (WiMAX), High Speed Downlink Packet Access (HSDPA), andthe like.

The short-range communication module 214 refers to a module forshort-range communication. Short-range communication technologies mayinclude Bluetooth, Radio Frequency Identification (RFID), Infrared DataAssociation (IrDA), Ultra Wideband (UWB), ZigBee, and the like.

The A/V input unit 220 serves to input audio signals and video signals,and may include a camera module 221 and a microphone 222, for example.

The camera module 221 processes image information including, e.g. astill image or a moving image captured by an image sensor in a videocall mode or an image capture mode. The processed image information maybe displayed on a display module 241.

Image data processed in the camera module 221 may be stored in thememory 250, or may be transmitted to, e.g., an external terminal throughthe terminal communication unit 210. Two or more camera modules 221 maybe provided according to use environments.

The microphone 222 receives an external sound signal, e.g., in a callmode, a recording mode or a voice recognition mode, and processes thesame into electrical voice data.

The user input unit 230 generates input data to allow the user tocontrol operation of the terminal 200. The user input unit 230 mayinclude a keypad, a direction key, a dome switch, a touchpad(constant-pressure/capacitive), a jog wheel, a jog switch, and the like.

The terminal output unit 240 serves to generate visual or auditoryoutput, and may include the display module 241 and a sound output module242, for example.

The display module 241 displays (outputs) information processed in theterminal 200.

For example, when displaying information related to the terminal 200 andthe refrigerator, the display module 241 of the terminal 200 may displaythe interior state of the refrigerator.

The display module 241 may include at least one of a Liquid CrystalDisplay (LCD), a Thin Film Transistor Liquid Crystal Display (TFT LCD),an Organic Light Emitting Diode (OLED), a flexible display, and a 3Ddisplay.

If the display module 241 and a sensor to sense a touch motion(hereinafter referred to as ‘a touch sensor’) are constructed in alayered structure (hereinafter referred to as ‘a touchscreen’), thedisplay module 241 may be used as an input device as well as an outputdevice.

The touch sensor may take the form of a touch film, a touch sheet, or atouch pad, for example.

The touch sensor may be configured to convert, e.g., a pressure appliedto a specific portion of the display module 241 or a variation ofcapacitance generated from the specific portion of the display module241 into an electrical input signal. The touch sensor may be configuredto detect a touch pressure applied to the display module 241 as well asa touched location and an area of the touched location.

When a touch input is generated with respect to the touch sensor, thesignal(s) corresponding to the touch input is transmitted to a touchcontroller (not shown). The touch controller processes the signal(s),and transmits data corresponding to the signal(s) to the terminalcontroller 280. Thereby, the terminal controller 280 may recognize,e.g., whether any region of the display module 241 is touched.

The sound output module 242 outputs data containing audio stored in thememory 250, or outputs sound informing the user of an operational stateof the refrigerator. The sound output module 242 may include a receiver,a speaker, or a buzzer, for example.

The memory 250 may store a program for processing and control of theterminal controller 280, and may contain information related to foodstored in the refrigerator.

In addition, the memory 250 stores graphic data to provide the user withvarious messages and information via various visual effects.

The above-described memory 250 may include a storage medium having atleast one type among a flash memory type, a hard disk type, a multimediacard micro type, a card type of a memory (for example, an SD or XDmemory), a Random Access Memory (RAM), a Static Random Access Memory(SRAM), a Read-Only Memory (ROM), an Electrically Erasable ProgrammableRead-Only Memory (EEPROM), a Programmable Read-Only Memory (PROM), amagnetic memory, a magnetic disc, and an optical disc.

The interface unit 260 serves as a path to connect various externaldevices to the refrigerator terminal 200. The interface unit 260 mayreceive data or power from an external device, and transfer the data orpower to each component in the terminal 200, or transmit internal dataof the terminal 200 to an external device.

For example, the interface unit 260 may include a wired/wireless headsetport, an external charger port, a wired/wireless data port, a memorycard port, a port for connection of a device having an identificationmodule, an audio Input/Output (I/O) port, a video I/O port, and anearphone port.

The terminal controller 280 typically controls an overall operation ofthe terminal 200.

The power supply unit 290 receives power applied from an external powersource through the interface unit 260 and supplies the power to operateeach component under control of the terminal controller 280.

Exemplary embodiments described herein may be implemented in a recordingmedium capable of being read by a computer or a similar device using,e.g., software, hardware, or a combination thereof.

According to hardware implementation, exemplary embodiments describedherein may be realized using at least one of Application SpecificIntegrated Circuits (ASICs), digital signal processors (DSPs), digitalsignal processing devices (DSPDs), programmable logic devices (PLDs),field programmable gate arrays (FPGAs), processors, controllers,micro-controllers, microprocessors, and an electric unit for performingother functions.

In some cases, exemplary embodiments described in the specification maybe implemented by the terminal controller 280.

According to software implementation, exemplary embodiments with regardto procedures and functions described in the specification may berealized by separate software modules. Each of the software modules mayperform at least one function and operation described in thespecification.

Software code may be embodied as a software application that is writtenin an appropriate programming language. The software code may be storedin the memory 250, and may be executed by the terminal controller 280.

FIG. 3 is a control block diagram according to one embodiment of thepresent invention. A description with reference to FIG. 3 will follow.

According to the present invention, a control unit 80 may be provided tocombine a plurality of pictures taken by the camera 100 with one anotherand correct the pictures into an image showing the receptacle 30.

In this case, the control unit 80 may correct a plurality of picturestaken by the camera 100 into a single image. Of course, the control unit80 may transmit a single picture taken by the camera 100 to an externaldevice, i.e. the terminal 200.

In particular, the control unit 80 may combine an image captured by thecamera 100 in a closed state of the door 20 and an image captured by thecamera 100 in an open state of the door 20 with each other, and maycorrect the images into an image showing the receptacle 30.

In this case, the closed state of the door 20 may mean a state in whichthe receptacle 30 is completely hermetically sealed, or a state in whichthe receptacle 30 is hermetically sealed to a designated level or more.

The image captured by the camera 100 in the closed state of the door 20and the image captured by the camera 100 in the open state of the door20 may show different regions of the receptacle 30. Accordingly, if thereceptacle 30 has a long length in a front-and-rear direction, pluralimages captured by the camera 100 may be combined with one another toacquire an image of the entire receptacle 30.

In this case, the open state of the door 20 may include a state in whichthe door 20 is open and is stationary. That is, the open state of thedoor 20 may mean that the door 20, i.e. the receptacle 30 is stationaryin a state in which the user is accessible to the receptacle 30. Forexample, the open state of the door 20 may correspond to a point in timeimmediately before the door 20 that has been forwardly withdrawn to openthe receptacle 30 is pushed rearward to hermetically seal the receptacle30.

Moreover, the open state of the door 20 may include a state in which thedoor 20 is open and is moving. That is, the open state of the door 20may mean that the door 20, i.e. the receptacle 30 is moving in a statein which the user is accessible to the receptacle 30. For example, theopen state of the door 20 may correspond to a duration for which thedoor 20 is being forwardly withdrawn to open the receptacle 30 or aduration for which the door 20 is being pushed rearward to hermeticallyseal the receptacle 30.

In addition, the open state of the door 20 may include a state in whichthe door 20 is open and is stationary, and a state in which the door 20is open and is moving.

The control unit 80 may combine two pictures taken by the camera 100 tocorrect the pictures into a single image, or may combine three or morepictures to correct the pictures into a single image.

The control unit 80 may provide the user with an intuitively and easilyrecognizable image by combining the pictures taken by the camera 100. Inthis case, the control unit 80 may implement combination of a pluralityof pictures and individual correction of the pictures. Meanwhile,combination of a plurality of pictures may be implemented by an externalcontrol device rather than the control unit 80 of the refrigerator.

According to one embodiment of the present invention, a receptacleposition sensing unit 130 may be provided to sense a position of thereceptacle 30. The receptacle position sensing unit 130 may checkwhether the receptacle 30 has been moved as well as a moved position ofthe receptacle 30.

In addition, when the receptacle position sensing unit 130 senses thatthe receptacle 30 reaches a predetermined position, the receptacleposition sensing unit 130 may transmit a related signal to the controlunit 80 to allow the control unit 80 to instruct the camera 100 to takea picture.

In this case, a plurality of positions may be predetermined with regardto the receptacle 30 such that the camera 100 takes a plurality ofpictures of the receptacle 30.

The receptacle position sensing unit 130 may include a Hall sensor usingHall effects. The Hall sensor may find the magnitude and direction of amagnetic field using Hall effects in which a potential difference isproduced across a conductor carrying an electric current when a magneticfield is applied in a direction perpendicular to that of the currentflow.

According to one embodiment of the present invention, a timer 140 may beprovided to measure passage of time. In this case, the timer 140 maymeasure, in particular, a movement duration of the receptacle 30,although the timer 140 may measure general passage of time.

When a predetermined time measured by the timer 140 has passed, thetimer 140 may transmit a related signal to the control unit 80 to allowthe control unit 80 to instruct the camera 100 to take a picture.

According to one embodiment of the present invention, a dooropening/closing sensing unit 150 may be provided to senseopening/closing of the second door 20. The door opening/closing sensingunit 150 may sense whether or not the second door 20 is released fromcontact with the main body 2, for example.

The door opening/closing sensing unit 150 may transmit informationrelated to whether the door 20 is open or closed to the control unit 80.

According to one embodiment of the present invention, a receptaclemovement direction sensing unit 160 may be provided to sense a movementdirection of the receptacle 30. In this case, the receptacle movementdirection sensing unit 160 may consist of a plurality of receptacleposition sensing units 130 to sense a movement direction of thereceptacle 30 using sensed results from the receptacle position sensingunits 130.

The receptacle movement direction sensing unit 160 may sense a movementdirection of the receptacle 30 and transmit a related signal to thecontrol unit 80. That is, the control unit 80 may detect a movementdirection of the receptacle 30 under assistance of the receptaclemovement direction sensing unit 160.

More specifically, since the receptacle 30 may be withdrawn from thesecond storage compartment 18 or be introduced into the second storagecompartment 18, the receptacle movement direction sensing unit 160 maysense whether the receptacle 30 is moving forward or rearward.

According to one embodiment of the present invention, an image storageunit 82 may be provided to store an image corrected by the control unit80. The image storage unit 82 may store all images corrected by thecontrol unit 80 including the most recently corrected image as well aspreviously corrected images.

The image stored in the image storage unit 82 may be transmitted to theterminal 200 or the display unit 120, and the user may recognizeinformation related to the interior of the refrigerator via the terminal200 or the display unit 120.

According to one embodiment of the present invention, an input unit 122may be provided to allow the user to input an instruction to therefrigerator. In this case, the input unit 122 may be integrated withthe display unit 120 to allow the user to input an instruction via thedisplay unit 120.

The input unit 122 may receive a general instruction with regard tocontrol of the refrigerator, and may also receive an instruction withregard to control of the camera 100.

According to one embodiment of the present invention, a communicationunit 84 may be provided to transmit an image corrected by the controlunit 80 to an external device. In this case, the communication unit 84may transmit a corrected image to the terminal communication unit 210 asexemplarily shown in FIG. 2.

In particular, the communication unit 84 may transmit an image stored inthe image storage unit 82 or an image corrected by the control unit 80to an external device.

Meanwhile, the control unit 80 may control the light source 86 to allowthe light source 86 to emit light to the receptacle 30 when the camera100 takes a picture.

FIG. 4 is an explanatory view of operation according to one embodimentof the present invention. First, constituent elements of the presentinvention will be described in detail with reference to FIG. 4.

The camera 100 may be installed in a front region of the storagecompartment. In this case, the front region of the storage compartmentmay mean a place proximate to a position where the door 20 is located.

In particular, the camera 100 may be installed to take a picture of thereceptacle 30 within a maximum withdrawal region of the receptacle 30.That is, even in a section where the receptacle 30 is maximallywithdrawn, a picture taken by the camera 100 may show the interior ofthe receptacle 30. In other words, the camera 100 may be located in amovement path of the receptacle 30 to ensure that an image captured bythe camera 100 shows the interior of the receptacle 30.

As the camera 100 is located in the front region of the storagecompartment, the camera 100 may capture images of the receptacle 30 atvarious positions during movement of the receptacle 30. That is,according to the present invention, the camera 100 is stationary,whereas the receptacle 30 is movable, which may allow the camera 100 totake pictures in various ways. In other words, according to the presentinvention, even if a single camera does not have an angle of viewrequired to take a picture of the interior of the entire receptacle 30,acquisition of the picture of the interior of the entire receptacle 30may be possible.

The receptacle position sensing unit 130 may be installed to the ceilingof the second storage compartment 18. In this case, the receptacleposition sensing unit 130 may include a plurality of Hall sensors 92 and94 installed to the barrier 6. In addition, the receptacle positionsensing unit 130 may include a magnet 90 provided at one side of thereceptacle 30. The magnet 90 has an effect on the plurality of Hallsensors 92 and 94 while being moved along with the receptacle 30,thereby assisting the Hall sensors 92 and 94 in determining a positionof the receptacle 30. That is, if the magnet 90 has an effect on therespective Hall sensors 92 and 94, it may be understood that thereceptacle 30 is moved to a position corresponding to the Hall sensors92 and 94.

The magnet 90 may be located at one end of the receptacle 30. Of course,the magnet 90 may be installed at various positions of the receptacle30.

In this case, the plurality of Hall sensors 92 and 94 may be spacedapart from each other, thereby serving to sense a moved position of thereceptacle 30. Of course, a greater number of Hall sensors than two Hallsensors 92 and 94 may be provided to enable more precise determinationof a position of the receptacle 30.

If the two Hall sensors 92 and 94 are provided, the Hall sensors 92 and94 may be located at trisection positions to divide the second storagecompartment 18 into three parts. In the case of the plurality of Hallsensors, it is desirable that the Hall sensors be equidistantly spacedapart from one another.

The camera 100 and the light source 86 may be installed to the barrier6. In this case, the camera 100 may be located proximate to a positionwhere the second door 20 and the barrier 6 meet each other. That is, thecamera 100 may be located closer to the second door 20 than the mainbody 2. The camera 100 is kept stationary regardless of movement of thesecond door 20.

The light source 86 may be positioned to emit light to the receptacle30. That is, the light source 86 may emit light downward.

The second door 20 and the receptacle 30 may be introduced or withdrawnalong the rails 22. In this case, the rails 22 may take the form oflines of plural screw threads, and the receptacle 30 may have a gear 24that is movable along the screw threads. That is, when the second door20 and the receptacle 30 are withdrawn from the second storagecompartment 18, the gear 24 may be rotated counterclockwise. On theother hand, when the second door 20 and the receptacle 30 are introducedinto the second storage compartment 18, the gear 24 may be rotatedclockwise.

In this case, the receptacle movement direction sensing unit 160 may beprovided at the gear 24. That is, the receptacle movement directionsensing unit 160 may sense a movement direction of the receptacle 30according to a rotating direction of the gear 24.

More specifically, it may be determined that the user withdraws thereceptacle 30 when the gear 24 is rotated counterclockwise, andintroduces the receptacle 30 when the gear 24 is rotated clockwise. Ofcourse, the receptacle movement direction sensing unit 160 may havevarious other shapes so long as it may sense a movement direction of thereceptacle 30.

The door opening/closing sensing unit 150 to sense opening/closing ofthe second door 20 may be mounted to the main body 2. The dooropening/closing sensing unit 150 may be mounted to the main body 2 at aposition where the second door 20 closes the second storage compartment18, and thus may be pressurized when the second door 20 comes intocontact with the main body 2. On the other hand, the dooropening/closing sensing unit 150 may be released when the second door 20opens the second storage compartment 18, i.e. when the second door 20 isseparated from the main body 2. That is, the door opening/closingsensing unit 150 may sense opening or closing of the second storagecompartment 18 according to whether or not the door opening/closingsensing unit 150 is pressurized by the second door 20.

Meanwhile, a plurality of cameras 100 may be provided. In this case, theplurality of cameras 100 may be arranged parallel to the second door 20.If the receptacle 30 has a great width, the receptacle 30 may deviatefrom a picture taking range of the camera 100. Therefore, a plurality ofcameras may be installed to eliminate a blind area of the receptacle 30.

With reference to FIGS. 4 to 6, operation according to one embodiment ofthe present invention will hereinafter be described.

The door opening/closing sensing unit 150 may sense whether the seconddoor 20 opens or closes the second storage compartment 18. Thus, thedoor opening/closing sensing unit 150 may sense a moment when the seconddoor 20 that has hermetically sealed the second storage compartment 18is open. That is, this moment may be recognized as a moment when thedoor opening/closing sensing unit 150 that has been continuouslypressurized by the second door 20 is released.

When the door opening/closing sensing unit 150 senses the opening momentof the second door 20, the camera 100 may take a picture.

Then, as the receptacle 30 is moved, the magnet 90 may have an effect onthe Hall sensors 92 and 94, thereby allowing the Hall sensors 92 and 94to determine a position of the receptacle 30. In this way, the camera100 may take a picture at a position where the magnet 90 has an effecton the Hall sensors 92 and 94.

That is, the camera 100 may take a total of three pictures until thesecond door 20 is moved from a closed state to a completely openposition. The pictures acquired at this time may provide images asexemplarily shown in FIG. 9.

Meanwhile, the light source 86 may emit light when the camera 100 takesa picture. Of course, the light source 86 may not emit light ifsufficient luminance to allow the camera 100 to take a picture isensured.

FIG. 7 is a control flowchart showing a picture taking process based onan elapsed time as the second door is open according to one embodimentof the present invention. A description with reference to FIG. 7 willfollow.

The door opening/closing sensing unit 150 may sense opening of thesecond door 20 (S10).

The timer 140 may measure an elapsed time starting from a moment whenthe second door 20 is open (S12).

In this case, the camera 100 may take a picture of the receptacle 30based on an elapsed time measured by the timer 140 (S14).

The elapsed time may be calculated by an average speed at which ageneral user moves the second door 20. That is, the camera 100 may takea picture of the receptacle 30 whenever the camera 100 passes thetrisection positions as the general user moves the second door 20.

Meanwhile, the elapsed time may mean two trisection points in time takenuntil the user completely withdraws the second door 20.

Then, it is determined whether or not the elapsed time ends (S16). Thatthe elapsed time ends may mean that the second door 20 is withdrawn to aposition where it is unnecessary to take a picture by the camera 100.

As the camera 100 has taken a plurality of pictures, the control unit 80may combine the plurality of pictures with one another (S18).

Then, the control unit 80 may correct the plurality of pictures into asingle image, and transmit the single image to a device except for thecamera 100 (S20).

Meanwhile, the plurality of pictures taken by the camera 100 may provideimages as exemplarily shown in FIG. 9, and finally may be transmitted tothe terminal 200 in the form of an image as exemplarily shown in FIG.10. The user may intuitively and easily recognize information related tofood stored in the receptacle 30 by the single image exemplarily shownin FIG. 10.

FIG. 8 is a control flowchart showing a picture taking process based ona movement direction of the second door according to one embodiment ofthe present invention. A description with reference to FIG. 8 willfollow.

First, the receptacle movement direction sensing unit 160 senses amovement direction of the second door 20 or the receptacle 30 (S22).This is because the receptacle 30 is fixed to the second door 20 and thereceptacle 30 and the second door 20 are moved together. That is, thereceptacle movement direction sensing unit 160 may sense whether thesecond door 20 or the receptacle 30 is introduced into or withdrawn fromthe second storage compartment 18.

When the receptacle movement direction sensing unit 160 senses theabove-described introduction or withdrawal, the camera 100 may take apicture of the receptacle 30.

If it is determined by the receptacle position sensing unit 130 that thereceptacle 30 reaches a predetermined position, the camera 100 may takea picture at the corresponding position (S24).

If it is determined that the receptacle 30 has reached all predeterminedpositions (S26), a plurality of pictures has been taken by the camera100, and therefore the control unit 80 may combine the plurality ofpictures with one another (S18).

On the other hand, if it is determined that the receptacle 30 does notreach all of the predetermined positions (S26), the camera 100 may stillready for taking a picture.

Then, the control unit 80 may correct the plurality of pictures into asingle picture, and transmit the single picture to a device except forthe camera 100 (S20).

Meanwhile, the plurality of pictures taken by the camera 100 may provideimages as exemplarily shown in FIG. 9, and finally may be transmitted tothe terminal 200 in the form of an image as exemplarily shown in FIG.10.

In this case, it is desirable that the camera 100 take pictures as thereceptacle 30 is moved to be introduced into the second storagecompartment 18, and the control unit 80 combines the pictures.

This is because the user may move the second door 20 forward when takingfood out of the receptacle 30 or storing new food in the receptacle 30,and thereafter move the second door 20 rearward to close the secondstorage compartment 18.

That is, the user will introduce the receptacle 30 into the secondstorage compartment 18 after accessing the receptacle 30 and completingdesired work, and the latest information related to the receptacle 30may be acquired upon occurrence of the above-described situation.

FIG. 9 is a view showing a plurality of pictures. A description withreference to FIG. 9 will follow.

The camera 100 may take a plurality of pictures as exemplarily shown inFIG. 9.

In this case, the taken pictures may provide an image as if the userlooks down the receptacle 30. This is because the camera 100 is orientedto take a picture downward.

Meanwhile, the camera 100 may take four or more pictures, or may taketwo or less pictures, rather than taking three pictures. That is,pictures taken by the camera 100 may be adjusted by adjusting the numberof pictures taken by the camera 100 and a picture taking range of thecamera 100.

For example, if a picture taking range of the camera 100 at a singlepicture taking time is increased, it is possible to reduce the number ofpictures taken by the camera 100.

On the other hand, if a picture taking range of the camera 100 at asingle picture taking time is reduced, it is desirable to increase thenumber of pictures taken by the camera 100, so as to acquire an image ofthe entire receptacle 30.

The camera 100 may be fixed to the main body 2, and the second door 20or the receptacle 30 may be moved. Accordingly, even if the camera 100is stationary, a picture taking region of the camera 100 varies as thereceptacle 30 is withdrawn by different degrees. The camera 100 may takea picture as the withdrawal degree of the receptacle 30 varies.

FIG. 10 is a view showing a state in which the pictures of FIG. 9 arecorrected and transmitted to the terminal. A description with referenceto FIG. 10 will follow.

Although FIG. 10 shows a picture displayed on the terminal 200, the sameinformation may be transmitted to the display unit 120.

In this case, the image contains content regarding the interior of thereceptacle 30. That is, the image may show the entire receptacle 30.

In addition, the image may provide a screen as if the user looks downthe interior of the receptacle 30 in a state in which the receptacle 30is sufficiently exposed to the user, thereby assisting the user inintuitively and easily recognizing the image.

Meanwhile, the image may be a single panoramic picture. That is, thesingle picture may prevent unnecessary increase in photo capacity whenthe picture is transmitted to the user.

The user may recognize information related to the state, kind, andnumber of food stored in the receptacle 30 by simply viewing the image.Accordingly, it is unnecessary to frequently open the door 20 of therefrigerator, and energy consumption may be reduced by preventingleakage of cold air of the second storage compartment 18 due to openingof the door 20.

In addition, when the user is away from home, the user may determinefood to be purchased and food not to be purchased using the image.Accordingly, waste of food due to repeated purchase and inconveniencecaused when not purchasing necessary food may be prevented.

FIG. 11 is a view showing an implementation example that a user isusable in the state of FIG. 10. A description with reference to FIG. 11will follow.

The image as exemplarily shown in FIG. 10 may be processed to providethe user with a shopping list of items that the user needs to purchase.

The shopping list of items may be produced and managed by the user asinformation related to food is directly extracted from the image, or asthe user extracts information related to food and additionally inputsand manages the information.

FIG. 12 is a front perspective view of a refrigerator according toanother embodiment of the present invention. A description withreference to FIG. 12 will follow.

Another embodiment of the present invention may be additionally appliedto the refrigerator according to the firstly described embodiment of thepresent invention. Of course, another embodiment of the presentinvention may be applied to a side by side type refrigerator in which arefrigerating compartment and a freezing compartment are located at leftand right sides, or a general refrigerator in which each of arefrigerating compartment door and a freezing compartment door opens orcloses a storage compartment via pivotal rotation thereof.

Accordingly, in the following description of another embodiment of thepresent invention, the same parts as those of the firstly describedembodiment of the present invention will not be described forconvenience of description. With regard to these parts a description ofwhich is omitted, the same or similar content may be applied to anotherembodiment of the present invention.

The drawer 40 provided below the shelf 14 internally defines thereceptacle (30, shown in detail in FIG. 14) in which food is stored. Inthis case, the drawer 40 may be introduced into or withdrawn from thespace defined below the shelf 14.

The camera 100 may be installed to the shelf 14 to take a picture of thespace below the shelf 14, i.e. the receptacle 30.

When the drawer 40 is sufficiently introduced into the space below theshelf 14, the space below the shelf 14, i.e. the receptacle 30 may behermetically sealed. The receptacle 30 may serve to store food, such asvegetables, etc.

Two drawers 40 may be arranged in a width direction to divide a width ofthe main body 2 into two parts. If the two drawers 40 are provided, itis desirable to provide two or more cameras 100. That is, the number ofthe cameras 100 may be equal to or greater than the number of thedrawers 40. As such, each camera 100 may take a picture of thereceptacle 30 of the drawer 40 proximate thereto.

If a plurality of drawers 40 is provided, the drawers 40 may beindependently introduced or withdrawn. Likewise, if the camera 100 isprovided to correspond to the drawer 40 in a one to one ratio, eachcamera 100 takes a picture of food stored in the receptacle 30 providedin the corresponding drawer 40.

The camera 100 may be centrally located in a width direction of thesingle drawer 40. That is, a single camera may be provided to take apicture of a single drawer. In addition, the camera 100 may be placed onthe shelf 14 so as not to be moved differently from the drawer 40,thereby serving to take a picture downward.

The light source 86 to emit light to the first storage compartment 12may be mounted in the first storage compartment 12. The light source 86may emit light to the first storage compartment 12 to allow the user torecognize the interior of the first storage compartment 12 when thefirst door 10 is open.

A portion of the shelf 14 and a portion of the drawer 40 may be formedof a transparent material. This serves to allow light emitted from thelight source 86 to be easily transmitted to the receptacle 13 throughthe shelf 14 and the drawer 40. With this feature, the camera 100 mayacquire sufficient luminance when taking a picture of the receptacle 30.

FIG. 13 is a control block diagram according to another embodiment ofthe present invention. A description with reference to FIG. 13 willfollow.

According to another embodiment of the present invention, the controlunit 80 is provided to combine a plurality of pictures taken by thecamera 100 with one another and correct the pictures into an imageshowing the receptacle 30.

In this case, the control unit 80 may correct a plurality of picturestaken by the camera 100 into a single image. Of course, the control unit80 may transmit a single picture taken by the camera 100 to an externaldevice, i.e. the terminal 200.

In particular, the control unit 80 may combine an image captured by thecamera 100 in a closed state of the drawer 40 and an image captured bythe camera 100 in an open state of the drawer 40 with each other, andmay correct the images into an image showing the receptacle 30.

In this case, the closed state of the drawer 40 may mean a state inwhich the receptacle 30 is completely hermetically sealed, or a state inwhich the receptacle 30 is hermetically sealed to a designated level ormore.

In this case, the open state of the drawer 40 may include a state inwhich the drawer 40 is open and is stationary.

Moreover, the open state of the drawer 40 may include a state in whichthe drawer 40 is open and is moving.

In addition, the open state of the drawer 40 may include a state inwhich the drawer 40 is open and is stationary, and a state in which thedrawer 40 is open and is moving. The definition of the open state of thedrawer 40 may be construed in the same definition of the open state ofthe drawer 20 according to the firstly described embodiment, and thus adescription of this will be omitted herein.

The control unit 80 may combine two pictures taken by the camera 100 tocorrect the pictures into a single image, or may combine three or morepictures to correct the pictures into a single image.

The control unit 80 may provide the user with an intuitively and easilyrecognizable image by combining the pictures taken by the camera 100. Inthis case, the control unit 80 may implement combination of a pluralityof pictures and individual correction of the pictures. Meanwhile,combination of the plurality of pictures may be implemented by anexternal control device rather than the control unit 80 of therefrigerator.

According to another embodiment of the present invention, the receptacleposition sensing unit 130 may be provided to sense a position of thereceptacle 30. The receptacle position sensing unit 130 may checkwhether the receptacle 30 has been moved as well as a moved position ofthe receptacle 30.

In addition, when the receptacle position sensing unit 130 senses thatthe receptacle 30 reaches a predetermined position, the receptacleposition sensing unit 130 may transmit a related signal to the controlunit 80 to allow the control unit 80 to instruct the camera 100 to takea picture.

In this case, a plurality of positions may be predetermined with regardto the receptacle 30 such that the camera 100 takes a plurality ofpictures of the receptacle 30.

The receptacle position sensing unit 130 may include a Hall sensor usingHall effects. The Hall sensor may find the magnitude and direction of amagnetic field using Hall effects in which a potential difference isproduced across a conductor carrying an electric current when a magneticfield is applied in a direction perpendicular to that of the currentflow.

According to another embodiment of the present invention, the timer 140may be provided to measure passage of time. In this case, the timer 140may measure, in particular, a movement duration of the receptacle 30,although the timer 140 may measure general passage of time.

When a predetermined time measured by the timer 140 has passed, thetimer 140 may transmit a related signal to the control unit 80 to allowthe control unit 80 to instruct the camera 100 to take a picture.

According to another embodiment of the present invention, a draweropening/closing sensing unit 350 may be provided to senseopening/closing of the drawer 40. The drawer opening/closing sensingunit 350 may sense whether or not the drawer 40 is released from contactwith the shelf 14, for example.

The drawer opening/closing sensing unit 350 may transmit informationrelated to whether the drawer 40 is open or closed to the control unit80. The drawer opening/closing sensing unit 350 may be provided at eachdrawer 40. This is because a plurality of drawers 40 may implementindividual and independent movement.

According to another embodiment of the present invention, the receptaclemovement direction sensing unit 160 may be provided to sense a movementdirection of the receptacle 30. In this case, the receptacle movementdirection sensing unit 160 may consist of a plurality of receptacleposition sensing units 130 to sense a movement direction of thereceptacle 30 using sensed results from the receptacle position sensingunits 130.

The receptacle movement direction sensing unit 160 may sense a movementdirection of the receptacle 30 and transmit a related signal to thecontrol unit 80. That is, the control unit 80 may detect a movementdirection of the receptacle 30 under assistance of the receptaclemovement direction sensing unit 160.

More specifically, since the receptacle 30 may be withdrawn from orintroduced into the space below the shelf 14, the receptacle movementdirection sensing unit 160 may sense whether the receptacle 30 is movingforward or rearward.

According to another embodiment of the present invention, the imagestorage unit 82 may be provided to store an image corrected by thecontrol unit 80. The image storage unit 82 may store all imagescorrected by the control unit 80 including the most recently correctedimage as well as previously corrected images.

The image stored in the image storage unit 82 may be transmitted to theterminal 200 or the display unit 120, and the user may recognizeinformation related to the interior of the refrigerator via the terminal200 or the display unit 120.

According to another embodiment of the present invention, the input unit122 may be provided to allow the user to input an instruction to therefrigerator. In this case, the input unit 122 may be integrated withthe display unit 120 to allow the user to input an instruction via thedisplay unit 120.

According to another embodiment of the present invention, thecommunication unit 84 may be provided to transmit an image corrected bythe control unit 80 to an external device. In this case, thecommunication unit 84 may transmit a corrected image to the terminalcommunication unit 210 as exemplarily shown in FIG. 2.

In particular, the communication unit 84 may transmit an image stored inthe image storage unit 82 or an image corrected by the control unit 80to an external device.

Meanwhile, the control unit 80 may control the light source 86 to allowthe light source 86 to emit light to the receptacle 30 when the camera100 takes a picture.

FIG. 14 is an explanatory view of operation according to anotherembodiment of the present invention, and FIG. 15 is a view showing aplurality of pictures. A description with reference to FIGS. 14 and 15will follow.

The camera 100 may be installed in a front region of the receptacle 30.In this case, the front region of the receptacle 30 may mean a portionthat the user will grip to open the drawer 40.

In particular, the camera 100 may be installed to take a picture of thereceptacle 30 within a maximum withdrawal region of the receptacle 30.That is, even in a section where the receptacle 30 is maximallywithdrawn, a picture taken by the camera 100 may show the interior ofthe receptacle 30.

The above-described method of taking a picture by the camera 100 may beequally applied to another embodiment of the present invention.

That is, the camera 100 may take a picture according to sensed results,i.e. a sensed point in time or a sensed position from the receptaclemovement direction sensing unit 160, the receptacle position sensingunit 130, and the timer 140. Thus, a detailed description of the samepart as that of the method of taking a picture by the camera 100according to the firstly described embodiment of the present inventionwill be omitted herein.

In particular, the receptacle position sensing unit 130 and thereceptacle movement direction sensing unit 160 according to anotherembodiment of the present invention may be installed and configured inthe same manner as those of the firstly described embodiment of thepresent invention. Since detailed configurations of receptacle positionsensing unit 130 and the receptacle movement direction sensing unit 160may be sufficiently understood from FIG. 4, the receptacle positionsensing unit 130 and the receptacle movement direction sensing unit 160are not illustrated in detail in FIG. 14.

The drawer opening/closing sensing unit 350 may be installed at aposition where the drawer 40 and the shelf 14 meet each other. That is,the drawer opening/closing sensing unit 350 may be installed to theshelf 14 such that the receptacle 30 is recognized as being hermeticallysealed when the drawer 40 applies pressure to the drawer opening/closingsensing unit 350. On the other hand, if the drawer 40 applies nopressure to the drawer opening/closing sensing unit 350, it may berecognized that the drawer 40 is withdrawn and the receptacle 30 is nothermetically sealed.

Of course, the drawer opening/closing sensing unit 350 may be modifiedinto various other shapes so long as it may sense opening/closing of thedrawer 40.

According to another embodiment of the present invention, the camera 100may take a picture while the drawer 40 is being moved in a closingdirection thereof as exemplarily shown in FIGS. 14(a), 14(b), and 14(c).

The user may access the receptacle 30 to take stored food out of thereceptacle 30 or to introduce new food into the receptacle 30 afteropening the drawer 40. Then, after completion of access to thereceptacle 30, the user may introduce the drawer 40 into the space belowthe shelf 14.

That is, the latest information related to the receptacle 30 may beacquired from a picture taken while the drawer 40 is being introduced bythe user.

Pictures taken at positions as exemplarily shown in FIGS. 14(a), 14(b)and 14(c) may be a plurality of split pictures as exemplarily shown inFIG. 15.

In this case, the control unit 80 may combine a plurality of pictures tocorrect the pictures into a single picture. The picture corrected by thecontrol unit 80 may be a panoramic picture.

The camera 100 may be fixed to a surface of the shelf 14 that faces thereceptacle 30, and the receptacle 30 may be moved. As such, the camera100 may take pictures at various positions of the receptacle 30, i.e. asthe withdrawal degree of the receptacle 30 varies.

Utilization with regard to another embodiment of the present inventionis equal to the firstly described embodiment of the present invention,and thus a detailed description of this will be replaced by thedescription of the firstly described embodiment.

FIG. 16 is a front perspective view of a refrigerator according to afurther embodiment of the present invention. A description withreference to FIG. 16 will follow.

As compared to the secondly described embodiment of the presentinvention, a further embodiment of the present invention has adifference in terms of an installation position of the camera 100. Inaddition, differently from the secondly described embodiment of thepresent invention, a further embodiment of the present invention has adifference in that the camera 100 takes a picture of the receptacle 30in a stationary state of the drawer 40. Accordingly, the followingdescription will focus on differences of related parts, and a detaileddescription of the same parts will be omitted.

The camera 100 is installed at a position deviated to one side in awidth direction of the drawer 40. That is, the camera 100 is locatedtoward one side of the drawer 40 to take a picture within a range fromone side to the other side of the drawer 40.

The light source 86 may be installed to the exterior of the receptacle30 rather than being installed within the receptacle 30. For example,the light source 86 may implement the same function as that of LightEmitting Diodes (LEDs) that emit light to the interior of the firststorage compartment 12 in a general refrigerator.

The shelf 14 and the drawer 40 may be formed of a transparent material.In particular, the shelf 14 disposed above the drawer 40 may be formedof a transparent material to allow light emitted from the light source86 to penetrate the shelf 14 and provide the interior of the receptacle30 with sufficient luminance.

FIG. 17 is a control block diagram according to a further embodiment ofthe present invention. A description with reference to FIG. 17 willfollow.

According to a further embodiment of the present invention, differentlyfrom the secondly described embodiment of the present invention, thereceptacle movement direction sensing unit, the receptacle positionsensing unit, and the timer are not provided. That is, according to afurther embodiment of the present invention, the camera 100 may take apicture in response to a sensed signal from the drawer opening/closingsensing unit 350 and a signal generated from the input unit 122.

The camera 100 may acquire information related to the receptacle 30 bytaking a single picture.

Accordingly, the control unit 80 may not need to combine and correct aplurality of pictures taken by the camera 100. That is, the control unit80 may transmit a picture taken by the camera 100 to the image storageunit 30, or may transmit the picture to an external device via thecommunication unit 84.

The timer 140 may measure an elapsed time from a point in time when thecamera 100 takes a picture. That is, the timer 140 may transmitinformation, related to an elapsed time from a point in time when thecamera takes the last picture, to the control unit 80 or the camera 100.

The camera 100 may take a picture in response to a signal generated fromthe input unit 122. According to a further embodiment of the presentinvention, the camera 100 takes a picture in a stationary state of thedrawer 40, and therefore the camera 100 may take a picture of thereceptacle 30 by operating the input unit 122.

In addition, according to a further embodiment of the present invention,the camera 100 may take a picture in response to a periodic signalgenerated by the timer 140.

Other constituent elements exemplarily shown in FIG. 17 are equal tothose of the secondly described embodiment of the present invention, andthus a detailed description thereof will be omitted.

FIG. 18 is an explanatory view showing a picture taking direction of thecamera in brief according to a further embodiment. A description withreference to FIG. 18 will follow.

The camera 100 may provide the user with information related to theinterior of the receptacle 30 via single picture taking. Thus, thecamera 100 may acquire information related to food stored in thereceptacle 30 via single picture taking.

More specifically, the camera 100 may be obliquely oriented at aprescribed angle θ₁ on the basis of a horizontal plane. In this case,the camera 100 may be oriented to face an opposite corner on the basisof a horizontal plane. Of course, instead of the angle θ₁, the camera100 may be tilted, on the basis of a horizontal plane, by an angle toensure that the camera 100 effectively takes a picture of food stored inthe receptacle 30. Note that the angle θ₁ may be zero degrees or more.

In addition, the camera 100 may be obliquely oriented at a prescribedangle θ₂ on the basis of a vertical plane. In this case, the camera 100may be oriented to face an opposite corner on the basis of a verticalplane. Of course, instead of the angle θ₂, the camera 100 may be tilted,on the basis of a vertical plane, by an angle to ensure that the camera100 effectively takes a picture of food stored in the receptacle 30.Note that the angle θ₂ may be zero degrees or more.

According to a further embodiment of the present invention, inconsideration of the fact that the camera 100 takes a single stillpicture of the interior of the receptacle 30, tilting the camera 100 mayensure acquisition of a greater quantity of information. This is becauseit is difficult to acquire information related to food stored in thereceptacle 30 via single picture taking if the camera 100 is orientedparallel to any one corner of the receptacle 30 rather than beingtilted.

FIG. 19 is an explanatory view of operation according to a furtherembodiment. A description with reference to FIG. 19 will follow.

According to a further embodiment of the present invention, asexemplarily shown in FIGS. 19(a) and 19(b), the camera 100 takes apicture at a moment when the drawer 40 closes the receptacle 30.

That is, after the user withdraws the drawer 40 and then completesaccess to the receptacle 30, the camera 100 takes a picture of thereceptacle 30 when the drawer 40 is again introduced by the user.

In this case, the light source 86 may emit light to the receptacle 30.Of course, since the first door 10 is open while the drawer 40 is beingintroduced by the user, the light source 86 may continuously emit lightwithout additional manipulation.

The drawer opening/closing sensing unit 350 may be installed to theshelf 14 and serve to sense opening/closing of the drawer 40 accordingto whether or not the drawer opening/closing sensing unit 350 comes intocontact with the drawer 40. As such, a moment when the drawer 40 beginsto apply pressure to the drawer opening/closing sensing unit 350 may berecognized as a moment when the drawer 40 is introduced into the spacebelow the shelf 14 to thereby hermetically seal the receptacle 30.

Accordingly, the camera 100 may take a picture of the receptacle 30 atthe moment sensed by the drawer opening/closing sensing unit 350.

That is, the camera 100 may take a picture of the receptacle 30 in astate in which the drawer 40 is introduced into the space below theshelf 14, i.e. in a state in which the space below the shelf 14 ishermetically sealed.

The picture taken by the camera 100 may be transmitted to the terminal200 through the communication unit 84.

In this case, the picture taken by the camera 100 may provide an imageas exemplarily shown in FIG. 20. That is, the picture taken by thecamera 100 provides an image as if the user obliquely looks down fromthe upper side of the receptacle 30.

FIG. 21 is a control flowchart showing a picture taking process based onoperation of the drawer according to a further embodiment. A descriptionwith reference to FIG. 21 will follow.

The user may operate the input unit 22 or set the timer 140 to generatea signal at a prescribed interval (S110). In this case, the user mayacquire information related to food stored in the refrigerator as theuser operates the input unit 122 or based on signals periodicallygenerated by the timer 140.

When the user operates the input unit 122 or the timer 140 generatessignals, the first storage compartment 12 is hermetically sealed by thefirst door 10. That is, even if the user does not open the first storagecompartment 12, the input unit 122 or the timer 140 enables picturetaking by the camera 100.

The light source 86 typically does not emit light in a closed state ofthe first storage compartment 12. Thus, it will be understood thatsufficient light to allow the camera 100 to take a picture is notemitted to the receptacle 30 and a picture taken by the camera 100 doesnot contain sufficient information related to the receptacle 30.

Accordingly, the light source 86 is actuated (S120). Since the shelf 14and the drawer 40 are partially formed of a transparent material, lightemitted from the light source 86 may penetrate the shelf 14 and thedrawer 40 to thereby reach the receptacle 30.

In this case, the camera 100 is in a stationary state, and thus may takea picture only one time (S130). This is because only the same picturemay be acquired even if the single stationary camera takes pluralpictures.

Later, the control unit 80 may transmit the picture taken by the camera100 to the image storage unit 30, or may transmit the picture to anexternal device via the communication unit 84.

In addition, the present invention may provide a storage apparatusincluding: a main body having a storage chamber in which an article isstored; a drawer configured to be moved forward of the main body; acamera located in a front region of the storage chamber to take apicture of the interior of the drawer in a state in which the drawer iswithdrawn to the maximum extent; a control unit configured to combine animage captured by the camera in a closed state of the drawer and animage captured by the camera in an open state of the drawer with eachother and configured to correct the images into an image showing theinterior of the drawer; and a display unit configured to show thecorrected image to a user.

In particular, in the above-described storage apparatus, the open stateof the drawer may include a state in which the drawer is open and isstationary.

Alternatively, in the above-described storage apparatus, the open stateof the drawer may include a state in which the drawer is open and ismoving.

In this case, the storage apparatus may include the refrigerator asdescribed above, and may refer to an apparatus that may provide a spacefor storage of industrial products and various other articles ratherthan food.

As is apparent from the above description, according to the presentinvention, a user may recognize information related to food stored in arefrigerator even if the user does not open a refrigerator door.

Further, according to the present invention, even when the user is awayfrom home, the user may recognize information related to food stored inthe refrigerator via a portable terminal.

Furthermore, according to the present invention, the user may view ascreen similar to that when the user directly opens the refrigerator,which assists the user in easily recognizing the interior state of therefrigerator.

It will be apparent that, although the preferred embodiments have beenshown and described above, the invention is not limited to theabove-described specific embodiments, and various modifications andvariations can be made by those skilled in the art without departingfrom the gist of the appended claims. Thus, it is intended that themodifications and variations should not be understood independently ofthe technical sprit or prospect of the invention.

What is claimed is:
 1. A refrigerator, comprising: a main body having astorage compartment; a door coupled to the main body and configured tomove forward of the storage compartment to open the storage compartmentand to move toward the storage compartment to close the storagecompartment; a receptacle received in the storage compartment andcoupled to the door so as to move together with the door; a camerainstalled at the main body to capture images of an interior of thereceptacle; a controller configured to combine an image captured by thecamera in a closed state of the door and an image captured by the camerain an open state of the door, and to correct the images into a singlecorrected image of the interior of the receptacle; and a displayconfigured to externally display the corrected image.
 2. Therefrigerator according to claim 1, wherein the open state of the doorcomprises a state in which the door is open with respect to the storagecompartment and is stationary.
 3. The refrigerator according to claim 1,wherein the open state of the door comprises a state in which the dooris open with respect to the storage compartment and is moving.
 4. Therefrigerator according to claim 1, wherein the camera is located at aposition corresponding to a front region of the storage compartment. 5.The refrigerator according to claim 4, wherein the camera is oriented soas to capture an image of the interior of the receptacle within amaximum withdrawal region of the receptacle.
 6. The refrigeratoraccording to claim 1, wherein the corrected image provides a view of theinterior of the receptacle looking down into the receptacle from abovethe receptacle.
 7. The refrigerator according to claim 1, furthercomprising a receptacle position sensor configured to sense a positionof the receptacle relative to the main body, wherein the camera isconfigured to take a picture of the interior of the receptacle when aspecific portion of the receptacle passes a predetermined position inresponse to a sensing signal generated by the receptacle positionsensor.
 8. The refrigerator according to claim 1, further comprising areceptacle movement direction sensor configured to sense a movementdirection of the receptacle, wherein the camera is configured to take apicture of the interior of the receptacle when the receptacle is movedin a direction to be introduced into the storage compartment in responseto a sensing signal generated by the receptacle movement directionsensor.
 9. The refrigerator according to claim 1, further comprising adoor opening/closing sensor configured to sense an open position of thedoor and a closed position of the door.
 10. The refrigerator accordingto claim 1, wherein the storage compartment comprises a first storagecompartment and a second storage compartment partitioned by a barrierwithin the main body.
 11. A refrigerator, comprising: a main body havinga storage compartment; a drawer slidably coupled to the main body so asto be introduced into and withdrawn from the storage compartment, thedrawer having a receptacle configured to receive items for storagetherein; a camera configured to capture images of an interior of thereceptacle; a controller configured to combine an image captured by thecamera in a closed state of the drawer and an image captured by thecamera in an open state of the drawer, and to correct the images into asingle corrected image of the interior of the receptacle; and a displayconfigured to externally display the corrected image.
 12. Therefrigerator according to claim 11, wherein the open state of the drawercomprises a state in which the drawer is open with respect to the mainbody and is stationary.
 13. The refrigerator according to claim 11,wherein the open state of the drawer comprises a state in which thedrawer is open with respect to the main body and is moving.
 14. Therefrigerator according to claim 11, wherein the camera is located at aposition corresponding to a front region of the receptacle.
 15. Therefrigerator according to claim 14, wherein the camera is oriented tocapture an image of the interior of the receptacle within a maximumwithdrawal region of the receptacle.
 16. The refrigerator according toclaim 11, further comprising an image storage device configured to storea last corrected image generated by the controller.
 17. The refrigeratoraccording to claim 16, further comprising a communication deviceconfigured to transmit the last corrected image stored in the imagestorage device to an external device.
 18. A storage apparatus,comprising: a main body having a storage chamber; a drawer slidablycoupled to the main body; a camera provided at a front region of thestorage chamber to capture an image of an interior of the drawer in afully open position of the drawer in which the drawer is withdrawn fromthe storage chamber to a maximum extent; a controller configured tocombine a first image captured by the camera in a closed state of thedrawer and a second image captured by the camera in an open state of thedrawer, and to combine the first and second images into a correctedimage of the interior of the drawer; and a display configured toexternally display the corrected image.
 19. The storage apparatusaccording to claim 18, wherein the open state of the drawer comprises astate in which the drawer is stationary, and in which the drawer is inthe fully open position, or in which the drawer is in a partially openposition.
 20. The storage apparatus according to claim 18, wherein theopen state of the drawer comprises a state in which the drawer is in apartially open positon and is moving.